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Response to Amendment 

The amendment filed 12/12/05 has been entered in full. 

Response to Arguments 

Applicant's arguments filed 12/12/06 have been fully considered but they are not 
persuasive. Specifically the Applicant argues that Nagashi fails to disclose "proposing to 
the subject an aesthetic feature for affecting the at least one external body condition 
based, at least in part, on the analyzing of the external body condition." Examiner 
respectfully disagrees. As discussed in the previous office action, Nagaishi discloses 
analyzing an extracted facial image to determine the condition of the skin (read as 
analyzing an external body condition) and outputs to the user advice regarding makeup 
(read as proposing to the subject an aesthetic feature for affecting the external body 
condition). Nagaishi does not explicitly disclose using a three-dimensional facial image 
however Furuta is relied upon for this. The applicant further argues that there is no 
motivation to combine. In response to applicant's argument that there is no suggestion 
to combine the references, the examiner recognizes that obviousness can only be 
established by combining or modifying the teachings of the prior art to produce the 
claimed invention where there is some teaching, suggestion, or motivation to do so 
found either in the references themselves or in the knowledge generally available to one 
of ordinary skill in the art. See In re Fine, 837 F.2d 1071, 5 USPQ2d 1596 (Fed. Cir. 
1988)and In re Jones, 958 F.2d 347, 21 USPQ2d 1941 (Fed. Cir. 1992). In this case, it 
is well known to one of ordinary skill in the art that a three-dimensional figure is more 
realistic and thus would give better beauty simulations thus enhancing the sales of the 
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products. The Applicant further argues that Furuta does not disclose applying the one 
captured image in a virtual manner on a three-dimensional frame. The Examiner 
respectfully disagrees. As discussed Furuta discloses a three-dimensional image, and a 
three-dimensional image must inherently have a three-dimensional frame. 

DETAILED ACTION 
Claim Rejections - 35 USC § 103 

1 . The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

2. Claims 2-6,8-17,19-32, and 38-39 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Nagaishi JP 2001 104050 in view of Furuta et al. US. Patent 
Publication 20010037191 (hereinafter "Furuta"). 

Naigaishi discloses a method of enabling an analysis using a facial image (all of 
the following taken from the English translation of the abstract), the method comprising: 
facilitating processing of the facial image to enable a beauty analysis; analyzing the at 
least one external body condition via the image (the condition of the skin is analyzed); 
and proposing (advice is given as to the makeup for the subject to wear) to the subject 
an aesthetic feature for affecting the at least one external body condition based, at least 
in part, on the analyzing of the external body condition (based on the analysis of the 
face). 
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Naigaishi does not explicitly disclose that the method uses a three-dimensional 
facial image and thus does not disclose facilitating construction of a three-dimensional 
facial image using at least one captured image of a subject's face. 

Furuta discloses a three-dimensional beauty simulation client-server system 
which is capable of handling a users face in a three-dimensional fashion and of 
providing more realistic beauty simulations (first sentence of the abstract). As seen in 
figure 3 multiple cameras are disclosed (1a, 1b) and the images are sent to the 3D face 
model generating unit 2. Alternatively if the user has a camera-equipped computer or 
internet cellular phone, a plurality of images obtained therefrom may be sent to the 
server, enabling the server 10 (figure 1) to construct a 3D face model (paragraph 32). 
Also disclosed is the makeup simulation unit 3 that allows simulations of makeup, 
cosmetic surgery, clothing, perfume, accessories, hair style, etc. based on the 3D 
information (paragraph 41). Using this simulation the consumers face may be 
reproduced with the new makeup style, etc. (paragraph 38). Furuta discloses that there 
is a problem with prior art systems in which the two dimensional image processing did 
not appear realistic, thus proposes making the system three dimensional (paragraphs 5 
and 6 of page 1 ). 

Naigaishi and Furuta are analogous art because they are from the same field of 
endeavor of make-up simulation using image processing. 

At the time of the invention it would have been obvious to one of ordinary skill in 
the art to modify Naigaishi's two-dimensional system to make it three-dimensional 
according to the teachings of Furuta. The motivation for doing so would be to provide 
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more realistic beauty simulations. Thus it would have been obvious to one of ordinary 
skill in the art at the time of the invention to combine Naigaishi and Furuta to obtain the 
invention of claim 20. 

Regarding claims 2-5, and 21-24 Furuta discloses that the means of the 
invention may be realized through software (paragraphs 161-162). Furthermore the 
server consists of a data control unit for storing information (10c figure 1). 

Regarding claim 6, makeup is a beauty product. 

Regarding claim 8, Furuta discloses that using morphing technology can enable 
one to resemble one's favorite model, and the user can learn what percentage of the 
image comprises her own features and what percentage comprises the models features 
(paragraph 41). Furthermore a simulation in which the level of beauty and degree of 
aging of the face are assessed can be carried out (paragraph 43). 

Regarding claim 9, Furuta discloses that the makeup simulation drawing software 
uses a method in which the face as a whole is made up by applying makeup to 
individual parts of the face, and the part of the face is selected by the user including lips, 
eyebrows etc. In this method the sought makeup style is pasted onto the image 
(paragraph 57). 

Regarding claim 10-11, as discussed Furuta discloses makeup. 

Regarding claim 12, Furuta discloses that it is possible to view the face from 
various angles, as if the camera viewpoint had continuously moved (paragraph 104). 

Claim 13 is dependent on claim 1 (rejected above by Furuta) and recites 
instructing the subject on how to transmit the at least one captured image to a location 
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remote from the subject, wherein the three-dimensional representation is constructed at 
the remote location. Furuta discloses that the consumer may send images to the server 
to construct 3D face data (paragraph 32). Furuta does not explicitly disclose instructing 
the subject on how to transmit the image. It is obvious that the internet site used to 
submit the images would provide some instruction as to how to submit the images, so 
that the user could avoid frustration of trying to find out for themselves how to do it, and 
thus experience a pleasant shopping experience and want to return in the future for 
more shopping. 

Claim 14 discloses prompting the subject to capture the at least one image of the 
subjects face. Furuta discloses that images may be captured (paragraph 32). It would 
be obvious to prompt the user before taking the image so that an image of the user with 
his eyes closed or in an awkward position would not be used for the later analysis. 

Regarding claim 15, Furuta discloses that the processing can take place through 
the internet to allow for analyzing the image at a location remote from the subject. 

Regarding claim 16, as seen in figure 3 a plurality of cameras (1a 1b) are used to 
capture a plurality of facial images. 

Regarding claim 17, Furuta discloses the facial image generator beginning with 
paragraph 108 in which a three dimensional structure (frame) is used in coordination 
with the captured images. 

Regarding claim 19, the evaluation can take place over an internet connection 
(1 1 figure 1 ) allowing for analyzing at a location remote from the subject. 
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Regarding claim 25, Furuta discloses that using morphing technology 
information to enable one to resemble one's favorite model may be obtained, for 
example intermediate images resembling a cross between the user and their favorite 
model may be created (paragraph 41). 

Claim 26 is similar to claim 1 , except it is directed to a computer readable 
medium. Thus the same arguments used for the rejection of claim 1 apply equally to the 
rejection of claim 26. 

Claim 27 is similar to claim 1 , except it is directed to a system. Thus the same 
arguments used for the rejection of claim 1 apply equally to the rejection of claim 27. 

Regarding claim 28, and 30-31 Furuta discloses applying a simulation of the 
three-dimensional data and displaying it thus it must be on a three-dimensional frame 
(paragraph 9 and paragraph 38). Furthermore this is from stored information and 
inputted information. 

Regarding claim 29, Furuta does not explicitly disclose that the three-dimensional 
frame is in the form of a virtual wire mesh. 

At the time of the invention, it would have been obvious to a person of ordinary 
skill in the art to use a virtual wire mesh to construct the three-dimensional facial image. 
Applicant has not disclosed that using a virtual wire mesh provides an advantage, is 
used for a particular purpose or solves a stated problem. One of ordinary skill in the art, 
furthermore, would have expected Applicant's invention to perform equally well with the 
method of Furuta for constructing the three-dimensional facial image . 
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Therefore, it would have been obvious to one of ordinary skill in the art to use a 
virtual wire mesh to construct the 3-d facial image as claimed in claim 29. 

Regarding claims 32 and 39, Furuta discloses a makeup simulation unit 3 using 
the facial model. 

Regarding claim 38, Nagaishi discloses analyzing the face image and outputting 
information showing the condition of the skin, and since advice is given based on the 
condition of the skin the extent and severity of the skin condition must be determined. 

3. Claims 33-37 are rejected under 35 U.S.C. 1 03(a) as being unpatentable over 
Nagaishi JP 2001 104050 in view of Furuta et al. US. Patent Publication 20010037191 
(hereinafter "Furuta") and further in view of Cosatto et al. USPN 6,504,546 (hereinafter 
"Cosatto"). 

Nagaishi nor Furuta explicitly disclose enabling a calibration of the three- 
dimensional facial image to address a perceived difference between the three- 
dimensional facial image and the subjects face. 

Cosatto discloses a method for modeling three-dimensional objects wherein 
using color calibration periodically the appearances of facial features can be tracked. In 
this manner reliable measurements of the outline of the facial features are obtained (col. 
8 lines 15-41). 

Nagaishi, Furuta, and Cosatto are all analogous art because they are all from the 
same field of endeavor of facial imaging. 



Application/Control Number: 10/024,615 Page 9 

Art Unit: 2625 

At the time of the invention it would have been obvious to one of ordinary skill in 
the art to enable calibration within the inventions of Nagaishi and Furuta as taught by 
Cosatto. The motivation for doing so is that changes in the appearances of the facial 
features can be easily tracked. Thus it would have been obvious to one of ordinary skill 
in the art at the time of the invention to combine Naigaishi, Furuta, and Cosatto in order 
to obtain the invention as specified in claim 33. 

Regarding claim 34, as discussed Cosatto discloses color calibration. 

Regarding claim 35, Furuta discloses a makeup simulation unit 3 using the facial 

model. 

Regarding claim 36, Cosatto discloses the color-calibrated three-dimensional 
facial image and Furuta discloses a makeup simulation unit 3 using the facial model. 

Regarding claim 37, Cosatto discloses that changes in the appearances of the 
facial features can be tracked. 

Conclusion 

THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 .136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1.136(a) will be calculated from the mailing date of 
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the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 

Contact Information 
Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to John B. Strege whose telephone number is (571) 272- 
7457. The examiner can normally be reached on Monday-Friday between the hours of 
8-5. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Bhavesh Mehta can be reached on (571) 272-7453. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 
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